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Description 

Display comprising an integrated loudspeaker and method for 
recognizing tactile contacts with a display 

5 

The invention relates to a combination consisting of a display and a 
loudspeaker in accordance with Claim 1 and method for recognizing 
tactile contacts with the display in accordance with Claim 10. 

10 A large number of electronic devices, such as mobile telephones or 

personal digital assistants for example, have both a display for the 
visual representation of information and also a loudspeaker for the 
audible reproduction of information. As a result of the continuing 
advances in the levels of miniaturization of such types of 

15 electronic devices, thought has been given for some time with regard 
to integrating components of the man/machine interface. 

The developments in this direction have in the meantime progressed 
to the point where displays, in particular a liquid crystal display 

20 (LCD) into which a loudspeaker is integrated, are at least in the 
prototype stage. Displays having an integrated loudspeaker are 
suitable above all for use in mobile telephones or generally in 
communication devices which comprise an optical and acoustic 
component in the man/machine interface and at the same time exhibit 

25 small dimensions. 

The advantage of integrating display and loudspeaker consists not 
only in the space saving aspect but also in reduced costs. Instead 
of two components, only one single component is required, even if it 
3 0 is more complex. This facilitates the production of electronic 
devices in which these components are used. 

With regard to the majority of displays having an integrated 
loudspeaker, at least one part of a sound-emitting surface is used 
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as the display. Such loudspeakers are also referred to as display- 
loudspeakers. Typically, with regard to such integrated systems the 
display cover consisting of a transparent plastic, which is intended 
to protect the actual display against impact and scratching, also 
5 forms the sound-emitting surface ("membrane") of the loudspeaker. 

A loudspeaker is known from GB 2360901 A in which an electronic 
display is used as the membrane. This loudspeaker is intended first 
and foremost for use with portable electronic devices. In 

10 particular, mobile telephones are mentioned as a field of 

application. In spite of the savings in terms of components 
resulting from this combination of loudspeaker and display, certain 
components of the man/machine interface of an electronic device are 
still always required such as a keypad or a microphone in the case 

15 of a mobile telephone, for example. 

The object of the present invention is to improve a display having 
an integrated loudspeaker to the effect that a further saving of 
components in the man/machine interface can be attained. 

20 

This object is achieved by a display comprising an integrated 
loudspeaker having the features in accordance with Claim 1 and by a 
method for recognizing tactile contacts with a display having the 
features in accordance with Claim 10. Preferred embodiments of the 
25 invention are set down in the dependent claims. 

One important concept of the invention consists in the fact that the 
display combined with a loudspeaker can be implemented as a touch- 
screen or touch- sensitive display. As a result, the display can be 
30 used for data input. The touch-sensitive display can take over at 

least a part of the functionality of a keypad. As a result, savings 
can be made in keypad components which as a rule are expensive and 
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complex in respect of production engineering. According to a 
further concept of the invention, savings are additionally made at 
least in part in components which are required for a touch-sensitive 
display. This is achieved according to the invention in particular 
5 by the fact that at least one part of the loudspeaker, in particular 
the at least one part of the sound-emitting surface of the 
loudspeaker which forms the display, forms a recognition means for 
tactile contact made with the display. Components of the loudspeaker 
are thus used both for the loudspeaker functionality and also for 
10 the touch-sensitive display functionality. As a result of this 

multi- function capability, further components of the man/machine 
interface for an electronic device can be saved. 

In concrete terms the invention relates to a display with an 
15 integrated loudspeaker, which is touch-sensitive. In addition, at 

least one recognition means for tactile contacts with the display is 
provided. 

As already mentioned, at least one part of the sound -emit ting 
/2 0 surface of the display which forms the loudspeaker can form a 

recognition means for tactile contact made with the display. In 
other words, the sound-emitting surface used for the touch-sensitive 
display simultaneously forms a recognition means for tactile 
contacts. For example, the sound-emitting surface can be used for 
25 forwarding pulses which are triggered by tactile contact with the 
display. The touch- sensitive display can also be used as a 
transmission means in order to convey tactile contacts made with the 
display to a further recognition means such as a sensor for example. 
This further recognition means can then evaluate the transmitting 
30 "tactile contact". 

( 

By preference, a recognition means for tactile contacts with the 
display is formed by means of at least one actuator of the 
loudspeaker and/or by means of at least one sensor, in particular an 
3 5 acoustic or optical sensor. In the former case, at least one 
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actuator of the loudspeaker has a dual function, namely it acts not 
only as an actuator but also as a sensor. Components for the touch- 
sensitive display can be saved as a result. In the latter case, 
special sensors are used which form a recognition means for tactile 
5 contacts with the display. 

Such types of actuators and sensors are preferably located in the 
vicinity of the edge or at the edge of the sound-emitting surface of 
the loudspeaker. In the case of acoustic sensors, this arrangement 

10 presents itself for a precise detection of a tactile contact. For 
example, small microphones can be used at the edge of the sound- 
emitting surface as acoustic sensors. These microphones can detect a 
tone emitted by the sound-emitting surface whose frequency lies in a 
range which is inaudible to human beings. If the display is now 

15 touched for example by means of a pen, then changes occur in the 

acoustic decoupling through the sound-emitting surface and thus in 
the emitted tone. These changes can be detected by the microphones. 

In a preferred embodiment of the loudspeaker, at least one actuator 
20 and/or sensor is/are located beneath the at least one part of the 
sound-emitting surface of the loudspeaker which forms the display. 
This presents itself first and foremost in the situation when a 
piezo-electric element is used as the actuator or sensor, which for 
example detects mechanical influences on the display resulting from 
25 tactile contacts. At least one actuator or sensor can also be 

located as an alternative or as an addition on the at least one part 
of the sound-emitting surface of the loudspeaker which forms the 
display. For example, piezo-electric elements used as actuators or 
sensors can be located directly on the side of the sound-emitting 
3 0 surface facing away from the acoustically active side, in other 
words beneath the sound- emitting surface. 
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In a particularly preferred embodiment, the at least one actuator 
comprises at least one piezo-electric element and/or one 
electromagnetic converter. In order to drive the sound-emitting 
surface, both piezo-electric elements (piezo-loudspeaker) and also 
5 electromagnetic converters (dynamic loudspeaker) can be used. For 
the loudspeaker functionality, these elements convert an electrical 
variable into a mechanical variable. Conversely, advantage can also 
be taken of the fact that these elements are also capable of 
converting mechanical variables into electrical variables. This 
10 functionality can be utilized for the detection of tactile contacts 
with the display. If separate sensors are used for the detection of 
tactile contacts with the display, then piezo-electric elements are 
preferred. Such types of sensors can have very small dimensions and 
are therefore well-suited for integration into a loudspeaker. 

15 

Finally, with regard to the loudspeaker according to the invention, 
evaluation means can also be provided for evaluating the signal 
delivered by at least one actuator and/or at least one sensor. These 
evaluation means can for example be integrated in a chip which is 
2 0 connected to the at least one actuator and/or the at least one 
sensor in such a way that it receives signals from these. 

The invention also relates to a method for recognizing tactile 
contacts with the display which is touch-sensitive and is integrated 
25 into a loudspeaker. In this case, at least one part of a sound- 
emitting surface forms the display. Tactile contacts with the 
display are recognized by a recognition means. 

For example, a tactile contact with the display can be recognized 
30 through a changed decoupling of sound by way of the sound-emitting 
surface of the loudspeaker and/or through changes in the standing 
waves or reflections on the surface. By preference, the changed 
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output of sound and/or a standing wave and/or reflections is/are 
picked up by using at least one sensor, in particular an acoustic or 
optical sensor. In this case, the changed decoupling of sound and a 
standing wave are picked up by way of an acoustic sensor, whereas on 
5 principle reflections can be detected both acoustically and 
optically . 

By preference the loudspeaker emits an audio signal which has a 
frequency outside the audible frequency range of sound waves. A 

10 tactile contact with the display can be recognized on the basis of 
changes in the audio signal output. By preference, the audio signal 
is emitted together with audio signals whose frequencies lie in the 
range which is audible to human beings, in other words it is 
superimposed on these. As a result of the fact that the audio signal 

15 has a frequency outside the audible frequency range, it is 

imperceptible to a human being and thus does not impair the acoustic 
quality of an electronic device in which the method according to the 
invention is being used. 

20 A tactile contact with the display can also be recognized by means 
of a reaction to at least one actuator in the loudspeaker, for 
example through a mechanical movement of an electromagnetic 
converter in the loudspeaker or of a piezo-electric element for 
driving the loudspeaker when tactile contact is made with the 

25 display. Accordingly, the at least one actuator preferably converts 
the force acting as a result of the tactile contact with the 
displays into an electrical signal which can then be further 
processed for detection of the tactile contact. 

30 In order to recognize the position of a tactile contact on the 

display, it is possible for example to evaluate the time difference 
between electrical signals from at least two actuators which detect 
the tactile contact. An impedance measurement and/or a differential 
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level measurement using the level of at least two signals from 
different sensors and/or actuators and/or an attenuation measurement 
of sound waves emitted by the sound surface in order to determine 
the position of a tactile contact on the display is also possible. 
5 Finally, multiple-path propagations and/or reflections of wave 

propagations triggered by the tactile contact with the display can 
also be evaluated on the surface. The results of these measurements 
and/or calculations, which can be performed as alternatives or 
collectively, can be used for the widest variety of control 
10 purposes. With regard to the evaluation of multiple-path 

propagations and/or reflections of sound waves emitted by the sound 
surface, a trained neural network is preferably used for signal 
processing, which enables a reliable recognition of the position of 
the tactile contact. 

15 

Further advantages and possible applications of the invention will 
emerge from the description which follows of exemplary embodiments 
with reference to the drawings, in which; 

2 0 Figure 1 shows a first exemplary embodiment of a loudspeaker having 



an integrated display, in which sensors are provided for 
recognizing tactile contacts with the display, in top 



view; 



25 Figure 2 shows the loudspeaker illustrated in Figure 1 in cross- 
section, 



30 



Figure 3 



shows a second exemplary embodiment of a loudspeaker 
having an integrated display, in which tactile contacts 
with the display are recognized through a reaction to 
actuators in the loudspeaker; and 



35 



Figure 4 



shows a third exemplary embodiment of a loudspeaker having 
an integrated display, in which sensors located beneath 
the sound- emit ting surface of the loudspeaker are 
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provided recognizing tactile contacts with the display. 

Figure 1 shows a loudspeaker having an integrated display 10. The 
loudspeaker 10 comprises a sound surface 12 with the display. 
5 Symbols 14 are represented in order to visualize the display. These 
symbols can for example identify a certain function which is 
triggered by touching the display at the position occupied by the 
respective symbol . Typical functions can for example be simple 
functions such as display illumination "On/Off" and ring tone 
10 "On/Off"; a loud/quiet control using a + /- regulator, a so-called 
slider, a more complex menu control facility or even a virtual 
keypad . 

By preference, an LCD is used for the display. The LCD 
15 simultaneously serves as an approximately flat sound-emitting 

surface for the loudspeaker. In order to drive the sound-emitting 
surface, or sound surface, 12, the loudspeaker 10 comprises an 
actuator 16 which is located beneath the sound surface. More 
precisely, the actuator 16 is located on the side of the sound 
20 surface 12 which is facing away from the sound -emit ting side. The 
actuator 16 can be a piezo-electric element or an electromagnetic 
converter, for example a coil in a magnetic field as in the case of 
a dynamic loudspeaker. 

25 Two sensors 18 are located at each edge side of the approximately 

square sound surface 12. Eight sensors 18 are provided in total. The 
sensors 18 are preferably small microphones. They detect a tone 
which is emitted by the sound surface 12 . This tone has a frequency 
which is outside the audible frequency range for a human being. If 

3 0 the sound surface with the display 12 is touched at a particular 

position for example by means of a pen, then the decoupling of the 
tone through the sound surface changes. This is registered by the 
sensors 18 . 
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By this means it is possible to detect a tactile contact with the 
display and to recognize on the basis of the special arrangement of 
the sensors where approximately the contact took place on the 
display. If for example the symbol 14 in the lower left corner of 
5 the sound surface 12 bearing the display is touched by a user using 
a pen, then the decoupling of the tone in this area of the sound 
surface 12 is particularly strongly influenced, with the result that 
the sensors 18 located in the vicinity of this area deliver a 
particularly intensive recognition signal which be processed 
10 accordingly by evaluation electronics connected downstream. 

The loudspeaker with integrated display 10 illustrated in Figure 1 
is shown in cross-section in Figure 2. The actuator 16 is located 
between the sound surface bearing the display 12 and a board 20 on 
which the loudspeaker 10 is mounted. On the board 20 are also 
mounted the sensors 18 and also a chip 22 . The chip 22 is used for 
evaluating the recognition signals generated by the sensors 18 and 
also for driving the display in the sound surface 12. In other 
words, the chip 22 controls the input and output functionality of 
the display in the sound surface 12. To this end, the chip 22 is 
connected by way of electrical lines 24 on the board to the sensors 
18 and to the display in the sound surface 12. By preference, it 
comprises an integrated signal processing circuit, for example a 
signal processor or a neural network for processing the signals 
delivered by the sensors 18 and an LCD drive unit for the 
representation of symbols 14 on the display in the sound surface 12. 

Figure 3 shows a loudspeaker 10 with integrated display, in which 
actuators 17 are used which each comprise an integrated sensor. 
3 0 Actuators of this type can for example be conventional 

electromagnetic converters or piezo-electric elements for driving 
the sound surface of the loudspeaker. The electromagnetic converters 
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or piezo-electric elements are conversely also used here for the 
detection of a force acting on the display or sound surface and thus 
serve as sensors . 

5 The actuators 17 are located with an approximately even distribution 
over the area which is covered by the sound surface 12 with display 
of the loudspeaker 10. By this means, tactile contacts over the 
entire area used for the display can be detected. The resolution for 
detecting the position of a tactile contact on the display is 
10 influenced by the number of actuators. For detection with a medium 
resolution, a smaller number of actuators is sufficient, six for 
example. This means that a costly conventional touchscreen whose 
complexity is unnecessary for a large number of application 
instances can be saved. 

15 

An evaluation and control circuit is used for evaluating signals 
which are generated by the integrated sensors of the actuators 17, 
in particular when a tactile contact is made with the display in the 
sound surface 12. In addition, control signals 26 are generated by 

2 0 the evaluation and control circuit 28, which are used for 

controlling the actuators 17 and thus for the output of sound by way 
of the sound surface 12. The evaluation and control circuit can be 
coupled by way of external signals 3 0 with further electronic 
components, for example in a mobile telephone or personal digital 
25 assistant, in which the loudspeaker 10 can be used. 

Figure 4 shows a loudspeaker 10 with integrated display in which an 
actuator 16 is located approximately centrally on the sound surface 
12 with display, more precisely beneath the sound surface 12 for 

3 0 driving the latter. In the edge zone beneath the sound surface 12, 

sensors 32 which are used for the detection of tactile contacts on 
the sound surface with display 12 are likewise located with an 
approximately even distribution. With regard to this embodiment, as 
in the case of the loudspeaker shown in Figures 1 and 2 separate 
3 5 actuators and sensors are used. A tactile contact on the display is 
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indicated by means of the illustrated pen 34 which touches the sound 
surface 12 with display and thereby generates a wave 36. The wave 
can be detected by the sensors 32 which can be implemented as piezo- 
electric elements . 

5 

The sensor signals 38 delivered by the sensors 32 are routed to an 
evaluation and display control circuit 40. The evaluation and 
display control circuit 40 evaluates the sensor signals 38 delivered 
by the sensors 32 and controls the display in the sound surface 12 
10 by way of display signals 42. The evaluation and display control 
circuit can be connected by way of external signals 44 to further 
electronic circuits, for example for signal processing and/or 
controlling the display and/or the loudspeaker. 

15 Note: The basic idea (and probably the most immediate embodiment) of 
the reported invention is to detect tactile contacts on the display 
using only 1 or 2 actuators, without additional sensors (advantage: 
cost savings, disadvantage: low detection accuracy where the display 
has been touched) . I would find it useful for this purpose to 

20 include an embodiment with an illustration in the application. 
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